A SHA G ARG Heterogeneous questionnaires and Rényi ’ s entropy
نویسنده
چکیده
— Recently we considered a heterogeneous questionnaire and characterized an average charge of order t by using the additivity property. Wefound that it is bounded from below by RényVs Entropy of order a, where a = 1/(1 +1), In this paper we have extended this workfor the more gênerai case vohen the order ofboth, the average charge and the bound, is same i. e. equal to a, This gives a new measure of average charge. We have characterized it and a related coding theorem has also been established. Résumé. — Nous avons récemment considéré un questionnaire hétérogène et caractérisé la charge moyenne d'ordre t en utilisant la propriété d'additivité. Nous avons trouvé qu'elle est bornée inférieurement par l'entropie de Rényi d'ordre a = l / ( l + t). Dans cet article nous étendrons le travail au cas plus général où les ordres de la charge moyenne et de la borne sont les mêmes, c'est-à-dire égaux à a. Cela donne une nouvelle mesure de la charge moyenne. Nous en donnons une caractérisation, et nous établissons un théorème de codage.
منابع مشابه
A Preferred Definition of Conditional Rényi Entropy
The Rényi entropy is a generalization of Shannon entropy to a one-parameter family of entropies. Tsallis entropy too is a generalization of Shannon entropy. The measure for Tsallis entropy is non-logarithmic. After the introduction of Shannon entropy , the conditional Shannon entropy was derived and its properties became known. Also, for Tsallis entropy, the conditional entropy was introduced a...
متن کاملThe Rate of Rényi Entropy for Irreducible Markov Chains
In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.
متن کاملCharacterization and lower bounds for addivive charges for heterogeneous questionnaires
— Information Theory hasfound interesting applications in Questionnaire Theory. Picard and Campbell have shown connections ofnoiseless Coding Theorems with average charge of a valid homogeneous questionnaires. Duncan has considered heterogeneous questionnaires and has shown thaï if log d is considered as the charge for a question of resolution d then the expected charge for the questionnaire is...
متن کاملCharacterizations based on Rényi entropy of order statistics and record values
Two different distributions may have equal Rényi entropy; thus a distribution cannot be identified by its Rényi entropy. In this paper, we explore properties of the Rényi entropy of order statistics. Several characterizations are established based on the Rényi entropy of order statistics and record values. These include characterizations of a distribution on the basis of the differences between...
متن کاملRényi Differential Privacy
We propose a natural relaxation of differential privacy based on the Rényi divergence. Closely related notions have appeared in several recent papers that analyzed composition of differentially private mechanisms. We argue that the useful analytical tool can be used as a privacy definition, compactly and accurately representing guarantees on the tails of the privacy loss. We demonstrate that th...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2017